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FOREWORD 


The  work  on  this  paper  was  wholly  supported  by  Contract  F  33615-67- 
C-1436  of  the  Aerospace  Research  Laboratories ,  Air  Force  Systems  Command 
United  States  Air  Force.  The  work  reported  herein  was  accomplished  on 
Project  7071,  "Research  in  Applied  Mathematics",  and  was  technically  moni¬ 
tored  by  Dr.  P.  R.  Krishnaiah  of  the  Aerospace  Research  Labs,  whose  interest 
in  the  present  work  is  greatly  appreciated. 


ABSTRACT 


Consider  a  p-variate  normal  population  N^(p_,E),  with  known  and  I 

unknown.  Without  loss  or  generality,  we  take  p  =  0_.  Sup, _ ,c.  that  we 

have  an  incomplete  multiresponse  sample,  i.e.,  we  have  samples  available 
from  this  population  and/or  its  various  marginals.  Suppose  one  is 
interested  in  estimating  £,  given  that  all  the  correlations  are  known. 

Consider  the  Fisher  information  matrix  H,  corresponding  t~>  the 
estimation  of  the  variances  a  .  Consider  the  marginal  involving  the 
responses  i  ,i^ , . . .  ,i^ ,  and  suppose  that  from  this  marginal  a  sample  of 
n( il ,i2 » • •  ,ik)  is  drawn.  It  is  then  seen  that  H  is  a  linear  function  of 
the  n's.  Suppose  that  the  cost  of  taking  an  observation  on  the  jth 
response  is  tji  ,  and  that  a  total  amount  of  money  j>'  is  available  for  the 
collection  of  samples.  The  problem  considered  in  this  paper  is  the 
following.  How  to  choose  the  n's  subject  to  the  cost  restriction,  such 
that  the  determinant  of  H  is  maximized.  A  complete  solution  is  obtained 
for  the  case  p  =  2.  When  p  =  3,  some  partial  results  are  obtained.  In 
particular,  it  is  shown  that  when  all  the  costs  are  equal,  and  the  corre¬ 
lations  are  equal,  then  the  best  design  is  obtained  by  using  a  complete 


sample . 


1.  Introduction 


In  most  experiments  or  investigations,  usually  more  than  one  response 
or  characteristic  is  measured  on  an  experimental  unit  or  individual.  The 
interest  very  often  lies  in  estimating  certain  parameters  (usually  of 
the  location  or  scale  type)  on  each  response.  It  is  well  known  that,  in 
general,  as  the  number  of  units  on  which  a  response  is  observed  is  in¬ 
creased,  the  efficiency  of  the  estimate  also  increases.  However,  in 
general,  one  is  fa 'ed  with  financial  limitations.  In  other  words, 
there  is  a  certain  cost  tK  of  measuring  the  j—  response  on  a  single  unit, 
and  there  is  a  cost  <|>  of  having  a  unit  available  for  the  experiment. 
Furthermore,  a  certain  total  amount  of  money  (say,  1)  is  allotted  for  the 
experiment.  In  this  situation,  not  only  the  number  of  observations  that 
can  be  taken  on  any  response  is  bounded,  the  number  of  observations  on 
other  responses  decreases  as  the  number  of  observations  on  a  particular 
response  is  increased.  This  indicates  that  an  overall  measure  of  the 
efficiency  of  the  whole  multiresponse  experiment  is  desireable.  Also, 
the  number  of  observations  to  be  taken  on  the  different  responses  should 
be  determined  so  as  to  maximize  the  overall  efficiency  of  the  whole 
experiment.  This  is  an  important  aspect  of  the  subject  of  multiresponse 
designs . 

Certain  problems  in  this  field  have  been  studied  before.  For  example, 
suppose  the  interest  lies  in  the  estimation  of  the  differences  between 
the  true  effects  of  a  set  of  v  treatments  on  each  of  a  set  of  p  responses. 
Thus  there  will  be  v  -  1  linearly  h.’ependent  comparisons  for  each 
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response,  giving  rise  to  p(v-l)  estimators.  Let  K  denote  the  p(v-l)  x 
p(v-l)  variance  matrix  of  these  estimators.  In  Srivastava  and  McDonald 
(1969),  the  problem  of  obtaining  the  optimal  multiresponse  design  (with 
respect  to  the  minimization  of  tr.  K)  is  considered.  This  paper  is 
concerned  with  the  case  of  randomized  block  designs.  A  similar  paper 
involving  cyclic  PBIB  designs  was  considered  in  Srivastava  and  McDonald 
(1970).  The  first  problem  under  the  determinant  criterion  was  considered 
in  Srivastava  and  McDonald  (1971). 

A  multiresponse  design  problem,  posed  in  a  somewhat  different  fashion 
has  been  considered  by  Hocking  and  Smith  (1971). 

In  this  paper,  we  consider  a  multiresponse  design  problem  when  such 
parameters  are  to  be  estimated.  The  optimization  under  the  given  cost 
restriction,  is  done  with  respect  to  maximizing  the  determinant  of  the 
fixed  information  matrix  corresponding  to  these  parameters. 

2.  Preliminaries. 

Consider  the  problem  of  designing  an  experiment  for  estimating  the 
unknown  dispersion  matrix  Z  =  ((cj^)),  (t,s  =  1,2,. . . ,p)  of  a  p-variate 
normal  distribution  whose  mean  vector  is  assumed  to  be  known  and  equal 
to  zero.  (This  choice  of  the  known  value  of  the  mean  causes  no  loss 
of  generality).  The  collection  of  data,  for  this  purpose,  could  be  in 


the  form  of  a  general  incomplete  multiresponse  sample.  This  sample  is 

divided  into  subsamples,  s_.  (j  =  l,w,..,u  =  2^-1)  such  that  on  every 

experimental  unit  in  S.,  exactly  the  subset  R.  (where  R.  = 

I  I  I  ll  }2  * 

...,  .  } )  of  lesponses  is  measured.  Thus  u  is  the  number  of  all  non¬ 


empty  subsets  of  (l,2,...,p),  and  n^  is  the  number  of  units  in  S_. .  The 
subsets  R.  are  assumed  to  be  ordered  in  any  arbitrary  but  fixed  manner. 
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We  also  assume  that  the  elements  of  R.  are  such  that  1  <  £  .  <  £._  <...<£.  <  p. 

3  “1-1-12  ip.  “ 

The  principal  submatrix  of  E  corresponding  to  R_.  is  denoted  by  E_.. 

For  any  response  r,  we  define  as  the  union  of  sets  S..  the  union  being 

taken  over  all  j  such  that  reR..  Thus,  U  is  the  set  of  all  units  on 
j  j  r 

which  response  r  (possibly  along  with  other  responses)  is  measured.  We 
shall  also  assume  a  cost  restriction  of  the  form  mentioned  in  the  intro¬ 
duction,  and  without  loss  of  generality,  label  the  responses  such  that 

12  p 

Our  objective  is  to  obtain  an  optimal  set  of  values  of  the  n^  under 
these  cost  limitations.  By  "optimal"  we  mean  the  sample  should  be  such 
as  to  maximize  the  "amount  of  information"  obtained  from  the  data  within 
our  financial  limitations. 

In  this  paper,  we  choose  our  measure  of  information  to  be  the 

determinant  of  Fisher’s  information  matrix  H.  For  convenience  of 

reference,  we  may  state  here  the  definition  of  H.  Suppose  in  any  given 

situation,  one  is  interested  in  estimating  a  set  of  parameters 

and  suppose  L  denotes  the  likelihood  of  the  sample.  Then  H  =  ((h^)) 

2 

is  (mxm),  and  =  E  (-3  log  L/30^30_.},  where  E  denotes  "expectation". 

Note  that  the  dispersion  matrix  V  of  the  estimators  is  asymptotically 
proportional  to  the  inverse  of  Fisher's  information  matrix  when  these 
estimators  are  maximum  likelihood  estimators,  or  belong  to  the  class  of 
asymptotically  efficient  estimators.  Also,  a  plausible  property  of  the 
determinant  criterion  is  the  fact  that  the  det.  H  and  det .  V  are, 
respectively,  directly  and  inversely  proportional  to  the  volume  of  the 
ellipsoid  of  concentration.  See,  for  example,  Roy,  Gnanadesiken  and 


Srivastava  (1971). 
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A  design  D,  in  this  study,  is  a  detarmination  of  the  vector  n  = 


(n^,n^,  . ..,n^),  specifying,  for  each  subset  of  responses, 
units  on  which  this  subset  of  responses  is  to  be  measured, 
satisfy  the  cost  restriction. 


the  experimental 

The  n . 's  must 
1 


u 

(2.1)  1  =  I  (C.)  n., 

j  =  1  1  1 

where  t. .  =  <(/  +  ^  ^  +  ...+  .  Under  each  design  D,  the 

11  °  jl  12  jp. 

criterion  of  optimization  is  represented  by  [det.  H(D)]  =  Q(D),  say, 
where  H(D)  is  the  matrix  H  corresponding  to  the  design  D.  Thus  we  are 
faced  with  an  optimization  problem  in  which  Q  is  the  objective  function 
and  (2  .  1)  is  the  constraint.  It  should  be  pointed  out  that  the  n_.'s 
should  also  be  positive  and  take  on  integer  values  only.  However,  for 
practical  considerations,  the  latter  requirement  shall  be  overlooked. 
The  cost  associated  with  a  design  D  shall  be  denoted  by  iHD). 

Definition  2.1  A  design  D  is  said  to  be  at  least  as  good  as  a  design 
D'  ,  if  Q(D)  >_Q(D')  and  i|>(D)  f.'l'(D').  Moreover,  if  any  of  the  two 
inequalities  becomes  strict,  then  D  is  said  to  be  better  and  D'  is  said 
to  be  inadmissible . 

Definition  2.2  A  (sub)  class  C  of  designs  is  said  to  be  essentially 
complete  in  the  class  C' ,  if  C  C  C'  and  for  any  D'eC',  there  exists  a 
DeC,  such  that  D  is  as  good  as  D'. 

3.  The  case  l  =  9 A,  A  known. 

Here,  we  shall  assume  that  the  positive  number  6  is  the  only 
unknown,  and  A  is  a  positive  definite  matrix.  An  easy  computation  then 
gives 
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3 


(3.1) 


2  £  n.p. 

H  =  E  (  -  2-iogL )  =  -ifl-ll 
30  26 


Thus  we  must  find  n's  so  as  to  maximize  £  n.p.  subiect  to  (2.1). 

j=l  :  1  " 

This  is  equivalent  to  maximizing  £*n^ ,  subject  to  Z*(£  /p  )n^  =  1,  where 
£*  denotes  summation  over  jeJ,  where  J  =  { j  | p_.  i  0}.  Let  j*  be  a  value 
of  j  such  that  (c.(p_.)  attains  a  minimum  (over  restriction  of  j  in  J)  when 
j  =  j*.  Then  clearly,  a  solution  of  the  problem  is:  Take  n_.  =0,  if 
j  i  j*,  and  take  n^&  =  (V? ^...) .  This  clearly  leads  to 

Theorem  3.1  Let  £*  =  (ip  +  ip,  +..+\p  );  r  =  l,..,p.  Let  n*  be  the  size 
-  r  o  1  r  r 

of  the  sample  from  the  marginal  distribution  of  responses  l,2,..r  .  Let 
r*  be  such  that  (r*/C*,..)  (r/C*>  .  Then  the  optimal  design  is 

obtained  by  taking  a  sample  of  size  (l/t£A)  from  the  marginal  of  responses 
l,2,..,r*  .  Clearly,  the  optimal  design  is  an  HM  design.  Also,  it  is 
easily  checked  that  this  HM  design  reduces  to  an  SM  design  if  and  only 

if  £  ^p_1/(P"l)* 

4.  The  case  of  uncorrelated  responses. 

In  the  case  of  uncorrelated  responses,  the  Fisher's  information  matrix 


H  reduces  to  a  diagonal  matrix  with  h  =  (21^)/^  ,  (t  =  l,2,...,p), 

where  N  =  n..  Our  problem  is  to  maximize  the  objective  function 

t  3eU r  1 

b 

Q  =  n  N  ,  subject  to  the  cost  restriction  (2.1),  which  is  now  equivalent 
t=1  b 

to  ip  N  +  £ipN  =1.  The  following  result  can  then  be  proved  in  a  way 
°  °  t=l  t  t 

parallel  to  theorem  4.2  in  Srivastava  and  McDonald  (1971). 
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Theorem  4,1.  Let  m^,...,m  denote  respectively  the  values  of 
which  maximizes  Q  subject  to  the  above  cost  restriction. 

(a)  Let  k  be  the  first  integer  such  that 

<*.l)  <k  -  2)*k  .  j  «  Cj*  .  2,  (X  -  l)*k  >  C{  .  !  . 

where  C*  =  ty  +  i/i  +...+\ p.,  and  k  can  take  the  values  2,  3,...,  p.  Then 
3  o  1  3 

the  optimal  design  is  an  HM  design  with 

(4.2)  m  =  ...  =  m  =  (k-1 )/ (p£*  ,),  and  m.  =  1/pip.,  (j=k,..,p). 

j-  1  K~i  3  3 

(b)  If  (4.1)  does  not  hold  for  any  value  of  k(2  k  <_p),  then 
we  have  the  SM  model  with  m,  =  m_  =  ...  =  m  . 

12  p 

5.  The  case  p  =  2,  and  known  correlation. 

For  the  case  of  a  bivariate  population,  let  n^  and  n^  be  the  sizes 
of  the  univariate  samples  from  the  marginals  of  the  first  and  second 
responses,  respectively.  The  size  of  the  bivariate  sample  will  be  denoted 
by  n3>  Also,  p  will  denote  the  correlation  coefficient  P^.  The  Fisher's 
information  matrix  H  is  given  by 


(5.1) 


1  <2n,  +  - - n„) 


H  =  ! 


2'  1  .  2  “3 

a  1  -  P 


tb  (n3  H4* 


1  ,  _ p" 

on  n3 


f2 


1  -  P 


lv2  1  -P 


*“T  (2n2  +  ~~^2  n3) 

o?  1  -  P 


We  proceed  now  to  find  the  optimum  design  under  the  determinant 
criterion.  We  want  to  choose  n^,  n2  and  n^  so  as  to  maximize  |w!  or, 
equivalently. 


(5.2) 


Q  =  nxn2  +  a(n1  +  n2^n3 


+  bn3 


2 


subject  to 


(5.3) 


d  =  n^d  +  n2d2  +  n3  ,  where 


6 


0 


I 

(5.4)  a  =  (2  -  p2)/2(l  -  p2),  b  =  1/(1  -  p2),  d  =  l/(tPQ  +  ^  +  *2>, 

dl  =  ^0  +  +i)/(*0  +  ^1  +  d2  =  ^0  +  +  +  ^2  ^  * 

The  inequalities  d^  <_  d2>  0  <_  d1  <_  1,  0  <_  <_  1,  d^.  +  >_  1,  a  =  b  ^ 

and  b  >  a  >  1,  can  be  easily  checked. 

Theorem  5.1.  The  sub  class  C*  of  HM  designs  is  essentially  complete  in  the 
class  C  of  GIM  designs. 

Proof:  The  assumption  <J^  <_  4<2  implies  that  a  design  D(n  ,n2,n3>  in  which 

L  n2  at  least  as  good  as  the  design  D* (n2 ,n^ ,n3> .  Consequently, 

designs  like  D'  shall  be  ignored.  Thus  let  Dec.  Construct  D*(m  ,m  ,m  ) 

X  Z  O 

as  follows.  Take  m^  =  n^  -  =  0,  and  m3  =  +  n^.  The  design  D* 

is  of  the  HM  type  and  an  equivalent  way  of  constructing  it  is  to  measure 
the  first  response  on  n  +  n  experimental  units,  then  measure  the  second 

X 

response  on  a  subset  of  these  units  of  size  n  +  n  .  We  have 

Z  >3 

2  2 
Q(D*)  =  mlm2  +  a(ml  +  m2)m3  +  bm3  =  a(n1  -n2)(n2  +  n3>  +  b(n2  +  n3>  . 

It  follows  that  Q(D*)  -  Q(D)  =  (a  -  Dn.^  +  (b  -  a)n22  +  2(b  -  a)n2n3  >_  0. 

We  also  find  that  ip ( D )  -  4>(D*)  =  ipQn2  >  0.  This  completes  the  proof. 

Thus,  we  will  restrict  attention  to  HM  designs  only,  by  taking  n2  =  0, 

.  2 

and  nl5n3  >_  0.  Our  problem  is  reduced  to  that  of  maximizing  Q  =  an.^n3  +  bn3  » 

subject  to  d  =  d  n  +  n  ,  n  ,n  0.  It  is  obvious  here  that  the  choice 

XX  o  X  o 

n  =  0,  is  never  optimal.  Now,  n.  =  d  -  n  d  ,  and  hence  Q  =  (d  n  -  d) 

3  o  XX  XX 

[(bd^  -  a)n^  -  bd].  By  considering  the  roots  of  this  quadratic  in  n^ ,  one 
can  easily  prove 

Theorem  5,2:  A  necessary  and  sufficient  condition  for  the  SM  model  to  be 

2  2 

optimal  is  that  ( \p 2 /  +  tj>^)  <_  (2  +  p  )/(2  -  p  ).  Otherwise  the  HM  design 

with  -  d(2bd^  -  a)/2d^(bd^  -  a)  and  n3  =  da  /  2(a  -  bd^),  is  the  optimal 
one. 
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6.  The  case  p  =  3. 

Consider  a  general  incomplete  sample  from  a  3-variate  normal  population. 

Let  us  assume  that  the  variances  are  unknown,  while  the  (3x3)  correlation 

matrix  (  (  p  )  )  (r,s  =  1,2,3)  is  known  and  the  mean  is  equal  to  the  zero 

vector.  For  simplicity  we  shall  use  the  notation:  P.  =  P.,  where  (i,j,k) 

1  k  l 

e  F,  and  F  is  the  set  of  (the  six)  permutations  of  (1,2,3).  Thus  this 

notation  means  P23  =  P32  =  p  ,  P12  -  p2i  =  p3’  p13  =  P31  =  p2*  We  find’ 

after  some  calculations,  that  the  elements  h..  of  Fisher's  information 

il 

matrix,  in  this  case,  are  (for  (i,j,k)eF)  given  by 


(6.1)  h. .  =  a. 

it  l 


-2 


C2n 


-1, 


.  +  a ,n.  .  +  a.n.  +  b.n  ],  h.  .  =  (o.o.)  (C,n  + 

l  3  13  k  lk  1  123  13  13  k  1’3 


+  d, n . . ) ,  where 
k  13 


2  2  2  2 
2-p  .  ,  ,  l-p.  P^P-  -p-  j  -  "p- 

ai  =  _ i_  ,  bA  =  1  +  _ i_  ,  ci  =  12  3  1  ,  = _ i_  , 

1-P.2  A  A  1-P.2 

1  1 


A  =  |  (  (p±  .  )  )|  =1-1  p/  +  2PXP2P3, 
X1  i=l  1 


and  where  n.(i=l,2,3),  n..(i^j;  i,j  =  1,2,3)  and  n  are,  respectively, 

1  J./LO 

the  sample  sizes  from  the  corresponding  univariate  marginals,  bivariate 
marginals  and  the  parent  distribution.  Define,  for  (i,j,k)eF, 


(6.2)  m. 

1 


a.a.h. . 
1  1  il 


gi  =  +h’ 


f 


Assume  that  the  total  money  available  for  taking  samples  is  1.  Our 
objective  is  to  find  a  determination  of  n_'  =  (n^,n2,n3,n^2,n^3,n23,n^23) 

which  maximizes  |h|  or,  equivalently,  the  quantity  Q,  where 

2  2  2  2  2  2 
(6.3)  Q  =  a  a2  a3  |h|  =  m1m2m3  +  "m1pi  ~  m2p2  “  m3P3  ’ 
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subject  to  the  cost  restriction 

(6.4)  1  =  S1n1+  g2n2  +  g3n3  +  +  fn^. 

A  direct  attack  on  this  problem,  by  way  of  expanding  Q  as  a  cubic  in  the 
7  elements  of  n,  seems  to  be  unwieldy.  The  subsequent  sections  will  offer 
alternative  methods  of  approach. 

7.  The  perturbation  method. 

We  start  by  assuming  that  the  design  D(n)  is  optimal,  i.e.  for  any 
other  design  D+  ( n_  )  we  have  Q(D+)  <  Q(D),  and  t|>(D)  =  <P(D  )  =  1.  This  means 
that  Q  has  a  global  maximum  at  the  point  determined  by  0.  Let  us  displace 
the  point  n_  to  the  point  n  +  6_.  Suppose  this  results  in  a  displacement 
of  (m  ,m2,m3,u1,u2,V3)  by  the  increments  (e^ *E2 »e 3 ,6i ’6 2 ,63 *  ’  resPectively- 
The  value  of  Q  undergoes  the  change: 


7.1)  Q(n  +  6}  -  Q(n)  =  I*  [1/2  e p(:T1j\“y i  )  +  9i(pjPk  '  +  P0  = 


=  px  +  p0»  say 


where  £*  shall  always  denote  summation  over  all  triplets  (i,j,k)eF,  and 

where  P  is  a  polynomial  of  e's  and  0's  of  the  third  degree  and 
G 


(7.2)  e .  =  26.  +  a, 6..  +  a. <5  +  b.5.-,,  6.  =  d.6  +  c.<5  . 

i  i  k  i]  ]  lk  l  123  l  l  jk  i  123 

The  sign  of  Q(n  +  6)  -  Q(n)  is  the  same  as  that  of  P  ,  provided  that  6_  and 
consequently  the  e's  and  the  9's  are  such  that  P0  is  negligible  compared 
to  P  .  By  the  use  of  (7.2),  the  polynomial  P1  can  be  expressed  directly 
in  terms  of  <5  as: 
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(7.3)  P  =  (WW'KV't  *  Sij<Vi  *  2Tkdk)]  *  *123  .Vbi*i,2Vi>- 

J  1=1 


where  =  m.m,  -  u.  ,  t.  =  y,  u .  -m.y..  Because  of  the  cost  condition 
l  3  k  l  l  k  ]  ii 

(6.4),  the  components  of  6  satisfy 


(7.4) 


+  g5  +  26  +  fS 

T1  82  2  S3  3  3  12 


+  f„6, .  +  f , 6 
2  13  1  23 


+  f  6 


123 


0. 


It  is  interesting  to  note  that  the  <j>'s  and  the  t's  are  the  six  different 

cofactors  of  the  (3  x  3)  matrix  ((g..)),  where  g..  =  o.cr.h... 

il  il  1  1  il 

Theorem  7.1:  A  design  D(n)  is  not  optimal  if  there  exists  a  6_  such  that 
D(r.  +  &)  is  a  design,  P1  is  positive  and  |  PQ  |  <_  | J  . 

Proof:  The  proof  is  evident  from  the  preceding  development. 

This  result  will  be  applied  to  some  important  special  cases. 

The  SM  model.  For  the  SM  model  we  have  all  the  n's  equal  to  zero,  except 

n123  =  1/t  =  m,  say.  Consequently,  for  (i,j,k)eF,  we  also  have 

2  2  2 
d>.  =m  (b.b.  -c.  ),  t.  =  (c.c.  -  b.c.)m  .  Thus 

•1  3  k  1  1  3  k  11 


(7.5) 


P,  =  m2Z*  [a. 6.  +  (l/2)(a,  a.  +  a.  a .  +  d.  6,  )  5.  .  + 
1  11  k  1  k  3  k  k  13 


(l/2)(bict.  + 


+  ciei^5q23^’  where 


a . 
1 


6. 

1 


2(c.c.  -  b.c. ) . 
3  k  11 


Let  a*  denote  the  coefficient  of  ^23  in  (7.5),  i.e.. 


(7.6)  a 


blal  +  b2a2  +  b3°3 


+  c1B1  +  c2B2  +  c3B3. 
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Substituting  in  (7.5),  the  value  of  us^nS  "the  cost  condition  (7.4), 

we  get 


(7.7) 


P1  =  (m  /2)E*  [(2d. 


^g./f)«.  +  (ava.  t  aka.  t  d^  -  «*fk/f)6..] 


Invoking  Theorem  (6.1)  and  observing  that  the  6's  in  (7.7)  must  be 
nonnegative  numbers  (n_  +  £  is  a  design)  which  can  be  taken  sufficiently 
small  so  that  |PQ|  <  |P  |,  we  obtain 

Corollary  7.1:  A  necessary  condition  for  the  Sh  model  to  be  optimal  is 
that , 


a*  >  (f)  max  (2a./g. , 

(i,j  ,k)eF  1  1 


(a. a.  +  a. a,  +  d.6.)/f.). 
i  j  i  k  li  i 


The  GIM  Model. 

Consider  the  GIM  design  D  with  n  >  Os  and  let  n  denote  the  coefficient 
of  <$123  in  (7.3),  i.e. 


(7.8)  n  =  b  t  b 2<P2  +  b3  <t>3  +  2x^0^  +  2t2C2  +  2l3c3’ 

Substituting  for  6  from  (7.4)  in  (7.3),  we  get 


(7.9) 


P1  =  E*[( 2*. 


ng./f)5.  +  (a^.  +  ak<t.  + 


2Tkdk  -  nfk/f)6ij](1/,2) 


According  to  theorem  (7.1),  a  necessary  condition  for  a  design  D  to  be 
optimal,  is  that  be  negative.  Moreover,  since  the  6's  can  be  both 
negative  and  positive  (the  n's  >0),  their  coefficients  must  vanish.  For 
example,  suppose  that  the  coefficient  of  6  ,  say,  is  not  zero,  then  we  can 
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select  all  other  6's  to  be  zero,  and  choose  6^  to  have  the  same  sign  as 
that  of  its  coefficient,  thus  giving  rise  to  a  positive  value  for  P  ,  which 
implies  that  Q  of  (6.3)  does  not  have  a  maximum  at  the  point  n  determined 
by  D.  We  have  established 

Corollary  7.2.  A  necessary  condition  for  the  (GTM)  design  D(n  >  0, 
n^  >  0,...,n^23  >  0)  to  be  optimal  is  that  all  the  following  hold 
s  imultaneolis  ly 

% 


(7.10)  (a)  ng.  ~  2f 4> -  ,(b)  hf.  =  (a.<t>.  *  a,<j> 

l  l  l  j  l  k 


+  2x  d  )f. 


The  conditions  (7.10),  in  addition  to  the  cost  restriction  (6.4) 
form  a  set  of  seven  equations  in  seven  unknowns.  Thus  we  could  (theoretic¬ 
ally)  solve  for  the  values  of  the  n's.  If  a  design  specifies  that  some 
subset  of  the  n's  of  size  x,  say,  must  be  zero,  then  in  (7.10)  we  would 
have  (6  -  x)  equations  and  x  inequalities.  Again  here,  with  the  cost 
restriction,  we  would  have  to  solve  (7  -  x)  equations  for  (7  -  x)  unknowns. 
For  any  design  D,  this  procedure  determines  the  optimal  values  of  the 
positive  n's  in  terms  of  the  costs  <(/.  and  the  correlation  coefficients 
ck.  Any  two  designs,  then,  can  be  compared  according  to  the  values  of  Q 
arising  from  adopting  each  of  them. 

The  HM  model. 


A  choice  of  the  vector  n  such  that,  say,  n^  >  0,  n^2  >  0>  and 
n^g  >  0,  while  the  rest  of  n's  are  equal  to  zero,  gives  rise  to  an  HM 
design.  From  (6.2)  we  have  tru  =  2n  +  a3n12  +  b^n  23*  m2  =  2n2  +  a3n12  + 

+  t>2n123,  m3  =  b3n123,  =  c,n.23,  u2  +  c2n123.  u3  =  d?n12  +  ^n^. 


1» 

.J 
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From  (7.4)  we  also  get  the  corresponding  values  of  and  as 

*1  =  a3Vl2ni23  +  (b2b3  ~  ^ICS’ 

^2  =  b3(2ni  +  a3nl2)n!23  +  'blb3  ’ 

^3  =  2a3nini2  +  'a3  "  d3  )ni2  +  *-a3(bl  +  b2)  "  2c3d3]nl2ni23  +  2b2nin] 

+  (b2bl  "  C32)ni23’ 

T1  "  t'(c2d3  "  a3Cl)nl2  ~  2cinl-'nl23  +  (C2C3  "  Clbl)r“l23’ 

T2  =  (Cld3  "  a3C2)n!2ni23  +  (ci°3  '  C2b2)nl23’ 

T3  =  (C1C2  “  C3b3)ni23  ~  b3d3nl2nl23‘ 

The  quantity  n  defined  in  (7.8),  after  some  simplification,  takes  on 
the  value 

2  2 

n  =  2(a3b2b3  +  a3b1b3  -  2b3c3d3  +  2c1c2d3  -  a3c1  -  a^  )n12n123 

t  4(b2b3  -  t  2a3b3nln12  *  b3(a32  '  d32>nL 

*  3<blb2b3  *  2C1C2C3  -  blCl2  *  b2C22  -  b3°32)"l23- 
Arguing  as  before,  one  arrives  at 


Corollary  7.3.  A  necessary  condition  for  the  optimality  of  an  HM 
design  with  n  ,  n  .,  n  >  0,  is  the  simultaneous  realization  of 

X  X  -L^  O 

the  following 


(a) 

ngi  = 

(b) 

nf3  = 

(a3*l  +  a34»2  +  2k3d3)f 

(c) 

hg2  - 

2f+2, 

(d) 

ng3  i 

2f*r 

(e)  nf?  1  ( a2^i  +  a2*^3  +  2k2d2)f’ 

(f)  ^  (ai$2  +  a1^3  +  2kldl^f’ 


Again  we  remark  here  that  (a)  and  (b)  above  with  the  cost  restriction 

1  =  e,n,  +  f„n,„  +  fn,„„  form  a  set  of  three  equations  from  which  we 
B1  1  3  12  123  n 

find  the  values  of  ,  n^2  and  n^23«  These  values  should  satisfy  the 
inequalities  (c),  (d),  (e)  and  (f). 
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8.  Designs  with  constant  Q. 

Given  a  design  D,  can  we  find  a  design  D*  that  gives  the  same  value 
for  the  objective  function  Q  as  D  does,  i.e.  Q(D*)  =  Q(D),  while  the  cost 
for  D*  is  less  than  that  for  D.  One  simple  way  of  achieving  this  is  to 
define  D*  such  that  the  values  of  the  m's  and  the  u's  (see  (6.2)  )  do  not 
change.  This  is  equivalent  to  saying  that  the  element  of  £_  satisfy  the 
following  conditions,  for  (i,j,k)  F. 


(8.1)  2<S .  +  ad..  +  a.  6  +  b-610-  =  0,  d.d.,  +  c.d 

l  k  ]  ik  1  123  l  ]k  l  123 


2«i23  t  ♦  q«ik>  <  o. 


Obviously,  if  such  d_  exists  and  the  design  D(n  +  <$_)  has  cost  1,  then  B(n) 
is  inadmissible. 

From  (8.1)  we  can  solve,  in  terms  of  ^23’  f°r  res‘t  of  the 
unknowns  and  obtain 


(8.2)  6.  =  ( 2d  .d  )  ~±  (a.c.d,  +  a.c.d.  -  b.d.d.  )6 

1  3  k  33k  k  k  3  13k  123 


'  4‘1[1  +  Ci2  -  (0i03/\)  -  (0iV°j,]{123 
*-  (ck/dkWi23  =  -  °k2y<1  -°k2)/<4ck2]  S123' 


Substituting  the  above  values  in  the  inequality  (8.1)  and  multiplying 
both  sides  by  2d^d^d3  <  0,  we  obtain 
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>  0. 


(8.4)  C-(Plp2p3  /A)(l/Pl2  +  l/p22  +  1/P32) 

+  (1/2A)(3  +  p2  +  p22  +  p32)  -  l/2]fi123^0  >  0. 

By  observing  that  the  case  PjP2P3  s  gives  rise  to  a  positive  value  for 
the  term  in  brackets  in  (8.6),  and  makes  (6^,$2,6  )  same  s^Sn  a£ 

6123’  and  612’<S13’623  °f  a  sign  °PPosite  to  that  of  6123>  and  using  a 
small  negative  value  of  we  are  led  to 

Theorem  8.1.  A  design  D(n)  in  which  n1»n2»n3  an(^  nj23  are  is 

inadmissible  if  P-^Pj  <  0. 

In  the  following  we  shall  assume  that  p  =  P  =  P  =  P,  say.  For  this 

1  4  v3 

case,  we  get 


(8.6)  cu  =  a  =  (2  -  p2),  Bi  =  B  =  1  +  (1  -  p2)/A, 

c.  =  c  =  (p3  -  p2)/A,  d.  =  d  =  ( -p2)/(l  -  p2),  (i  =  1,2,3). 


Theorem  8.2.  If  <  ij;„  and  o,  =  p„  =  p„,  then  we  must  have  either 

~  i  4  JL  L.  o 

n1  1  n  ,  or  n  3  >.  n23>  or  both  . 

Proof :  Suppose  the  theorem  is  not  true,  and  let  D(n_)  be  a  design  in  which 
n^  <  n2  and  n^3  £.  n23*  Construct  the  design  D*(n*)  where  n*  =  (n2,n^, 

n3’nl2’nl3’rP3,nl23^'  Tt  follows  the  “  ’HD*)  =  (^  -  ^i^n2  “  i^)  1  °» 

which  means  that  D*  costs  less  than,  or  as  much  as  D.  Now  we  shall  compare 
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0>  >  0. 


We  find 


Q(D)  with  Q(D*).  Let  n2  -  n^  =  0  >_  0  and  n^^  -  n^3  = 

that  m*  =  m  +  20,  m*  =  m„  -  20,  p*  =  p  ,  p*  =  p  and  p*  =  p_.  It  can 
X  Zz.  X  1  l  2  3  3 

easily  be  verified  that 


Q C D" )  -  Q(D)  =  200'  (a[2n3  +  a(n13  +n23  )  +  bn123^-  d^-d*-ni3  + 
+  n23)  +  2cn123]}  . 


Thus  Q(D*)  -  Q(D)  is  >_  0  if  and  only  if  2an  +  a2(n  +  n  )  +  abn 

O  1 J  4 O  lid 


2 

—  d  ^nl3  +  n23^  +  2c^Cnl23’  From  we  r-*e  that  a  >_  1  +  |d|  and 

b  >_  1  +  |c|  ,  which  implies  that  the  preceding  inequality  always  holds, 

which  in  turn  implies  that  Q(D*)  Q(D).  This  completes  the  proof. 

9 .  The  case  of  equal  costs  and  correlation  coefficients. 

In  this  section  we  study  the  case  where  for  all  i,  we  have  =  V  and 

P .  =  o .  We  first  state  a  result  for  later  use. 
i 

Lemma  9.1.  Consider  a  space  S  of  dimension  p(p  +  l)/2,  whose  points 

are  non-negative  definite  symmetric  matrices  of  size  (p  x  p).  Let  BeS 
1 

and  let  f(B)  =  | B | ^ .  Then  f  is  a  concave  function  on  S. 

Proof:  See,  for  example,  Mine  and  Marcus  (1964,  p.  115). 

a 

Given  BeS,  and/permutation  a  of  the  elements  {l,2,...,p},  let  a(B) 
be  a  matrix  obtained  by  permuting  rows  and  columns  of  B  (the  same  permuta¬ 
tion  for  rows  as  for  columns).  We  have  la  ( B ) I  =  | B | .  Let  B*  =  -4—  ,?  a(B). 

'  iii  pi  all  a 

Lemma  9_.  2 .  We  have  |  B’’r  |  >  |  3  [ . 

Proof:  By  Lemma  9.1,  and  the  definition  of  concave  function,  we  get 


IP  - 


1 

p! 


S  | 

all  a1 


1 

a(B)|P 


or 


|b*|  i  |b|  . 
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Now,  for  any  design  D(n  ,n  ,n3  ,n12 ,n13 ,n23 ,n123 ) ,  construct 

D*(v1’V1’V1’V2’V2,V2’T1123)’  where  vi  =  (ni  +  n2  +  n3')//3’  V2  =  (ni9  +  ni3  + 

+  n23)/3.  Because  of  equal  costs  we  have  =  3(*p  +  +  3(^0  +  + 

%  +  3*)nl23  =  (4,0  +  *Kni  +  n2  +  n3}  +  (*0  +  2,|;)(nl2  +  nl3  +  n23)  + 

(i^q  +  3l^n123  =>I/(D)*  And  because  of  equal  correlation  coefficients  we 

can  easily  find  that  m*  =  m*  =  m*  =  (m^  +  m2  +  m3)/3,  and  u*  =  u*  = 

V*  =  (u  +  m2  +  P3)/3.  Given  any  design  D,  let  M  be  the  (3  x  3)  matrix 

((m. .)),  with  m. .  =  m. ,  m  =  u  ,  m  _  =  v0,  and  m  =  p  .  It  is  obvious 

1^1  11  1  1-2.  O  i'3  ^  4  J  J.  c 

i  X  ^ 

that  Q(D)  =  { M |  It  can  also  be  easily  checked  that  M*  =  xt —  £  cx(M). 

3'  a  =  1. 

From  Lemma  9.1,  it  follows  that  |m|,  or  Q(D5':)  >_Q(D),  We  have 

established 

Theorem  9.1.  Consider  the  case  of  equal  costs  and  correlations.  Given  any 

design  D^n1 ’n2 ’n3 ’ni2 ,ni3 ,n23 ,nl23 ^ ’  the  design  D*^ V1  ,V1  ,V1 ,V2 ,V2  ,V2  ,ni23 ^ 
is  at  least  as  good  as  D,  where  v  =  (n^  +  n2  +  n3>/3,  and  =  (n^2  + 

+  ni3  +  n23)/3‘ 

Remark :  The  extension  of  this  result  to  general  p  is  immediate. 

Theorem  9.2:  In  the  case  of  equal  correlations,  a  design  in  which 
n^ ,n2 ,n^ ,n12g  >  0,  is  inadmissible. 

Proof:  We  shall  follow  the  approach  of  keeping  Q  fixed  and  reducing  the 

cost  described  in  section  8.  From (8,^  we  find  that  the  coefficient  of 

is  (1  -  p)/(l  +  2p).  The  fact  A  >  0  implies  that  p  >  -1/2,  which  in  turn 

implies  that  the  coefficient  of  is  always  positive.  Thus  we  can  take 

6  <0. 

123 

Formulas  (8.5)  also  become 


h  =  52  =  S  =  (1/1  +  2D)6123’  612  =  613  =  623  =  '(1  +  p/1  +  2p>6123 
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This  shows  that  an^  ^3  are  of  The  same  sign  as  <$12g »  while  ^2*  ^13 

and  6  have  a  sign  opposite  to  that  of  5  .  The  proof  is  completed  by 

/o  xZ  3 

continuing  as  ir  theorem  8.1. 

Corrollary  9.1.  In  the  case  of  equal  costs  and  equal  correlations,  a 
design  in  which  both  and  \jg  are  positive  is  inadmissible,  where 

V1  =  ni  =  n2  =  V  and  n!23  =  V 

Proof :  Use  theorems  9.1  and  9.2. 

Lemma  9.3:  In  the  case  ip.  =  ip  ,P .  =  p(i  =  1,2,3),  the  condition  v  =  0 
-  1  L  1 

implies  that  the  optimal  design  must  have  =  0,  and  the  SM  model  is 
optimal. 

3  3  2 

Proof:  Let  n,  „„  -  v„.  Our  obiect  is  to  maximize  0  =  m  +  2v'  -  3miJ  - 

-  1/3  3 

2 

=  (m  -  u)  (,-n  +  2v ) ,  subject  to  1  =  3(<b  +  2p)  v„  +  (ip  t  3ip)v  =  x  m  + 

U  /.  U  3  X 

XgU,  say  where  m  =  2av0  +  bVg  and  u=  dv?  +  cVg.  Solving  for  ^V2’V3^ 
we  find 


2ac  -  bd 


-b  1  I  m 


L  -d  2a  J  L  u 


Hence 


x  =  [(3c  -  d ) vp q  +  (6c  -  3d)i}j]/(2ac  -  bd). 


x^  =  [(2a  -  3b  Hq  +  6(a  -  b)i/>]/(2ac  -  bd ) , 


Now,  we  have 


3c  -  d  =  -P2(2  +  P)/(1  -  P2)(l  +  2?', 
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2c  -  d  =  -p2/(l  +  2p ) ( 1  -  p2) 


2a  -  3b  =  2[(1  +  P)2  -  p3]/(l  -  p2)(l  +  2p ) , 
a  -  b  =  -p2/(l  -  p2)(l  +  2p ) , 

2ac  -  bd  -  -2p2/(1  -  p2)(l  +  2p ) . 

Hence 

x  =  (1/2 )( 2  +  p  )i|<  +  (3/2),  x2  =  C ( 1  +  p)/p)2  -  p]  'I  +  3. 

3  2 

Now  u  =  (1  -  and  hence  0(m)  =  (1/x^)  [(x^  +  x^Im  -  ll 

[u2  -  2x^ )m  +  2].  This  is  a  cubic  polynomial  in  m,  with  coefficient  of 

3 

m  havii  g  the  same  sign  as  (x2  -  2x^)(x0,x^  being  non-negative).  rut 

~i  2 

-  2x^  =  f(l  -  p'  )(1  +  2p)/p  ]ij)  >_  0.  The  equation  0(m)  =  0,  has  a 
double  root  m^  given  by  =  [l(x2  +  x^)1  0  (x^,x0  >_  n).  Also,  i;  has 

a  single  root  m+  =  [2/(2x^  -  x0)l  0  , 

In  the  plane  (v^jV^),  the  cost  constraint  restricts  the  set  in  which 
V"  want  to  maximize  Q,  to  the  line  segment  between  the  two  points, 

("1/(3^  +  6^),  0]  and  TO,  1  / ( ih ^  +  3'J/)].  This  line  segment  is  transformed 
to  a  line  segment  whose  protection  on  the  m-axis  is  the  interval  (m'  ,  m") 
where  m'  =  a/(3/2>I0  +  3C’),  m"  =  t>/ ( ^  +  3tM . 

Now  a  <_b,  which  implies  that  m'  <_  m" .  At  this  stage,  we  would  like  to 

show  that  m'  is  larger  than  the  value  of  the  double  root  m  .  Now  m  = 

p  p 

2 

l/[(l/2)(2  t  p)ii>  +  (  (1  +  p)/p)  '!'n  -  pt;.'^  +  a/2’1'1.  Since  a  >  3,  our  obiect 

2 

will  he  accomplished  if  we  show  that  (l/2)(2  +  p)  +  (  (1  +  p)/p)'  -  o  -  3/2 

>  0,  or  (1  +  p)2/p2  -  (1  +  p )/?  =  (1  +  p )(2  +  2p  -  p?>/(2p2)  =  I ( l  +  o'! 
o  o 

(1  +  2p  +  1  -  p  )/(2p")l  >_  0.  Thia  however,  is  always  true.  Thus  0,  plotted, 
as  a  function  of  m,  is  tangent  to  the  m  axis  at  m  ,  and  is  a  monotone 
increasing  function  of  m  for  m  >_  m  .  We  conclude  that  Q  achieves  its 


i  vc 
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restricted  maximum  at  the  point  m"  =  b/(^  +  3ip),  for  which  p "  =  c / ( t p  + 

The  inverse  image  of  the  point  (m",  p")  in  the  (V2»V3^  plane  is  the 
point  fO,  l/(i|>  +  3<M1.  Thus  the  SM  design  is  the  optimal  one  as  the 

lemma  states. 

Lemma  9.4:  In  the  case  of  equal  costs  and  correlations,  a  design  in  which 
=  0,  cannot  be  optimal. 

Proof:  Assume  that  ^vq’v^’vq’V2,V2,V2’X,3^  an  design  In  which 

=  0.  We  will  proceed  to  determine  the  exact  values  of  and  v0.  We 

shall  also  adhere  to  the  same  scheme  and  notation  as  in  the  nroo^  of 

o 

Lemma  9,3.  In  the  present  case,  we  want  to  maximize  0  =  (m  -p )  (m  +  2p ) , 

subject  to  1  =  3(^0  +  +  3(i|>n  +  2^V2  =  KJm  +  x?u  ’  wdere  m  = 

+  2av?,  u  =  dv^.  We  find  that  x^  =  (3/2 )(i|>0  +  iM  °»  and  that  x^  = 

2 

3(1  -  aHQ/d  +  3(2  -  aW/d  =  3<{>q/P  +  3^  0.  The  coefficient  of  the  cubic 

2 

term  in  0(m)  has  the  same  sign  as  x^  -  2x^  which  is  equal  to  (3/p  )  - 

3^q  L  3*  The  equation  Q(m)  =  0  has  a  double  root  =  [l/(x^  +  x^)!  0, 

and  a  single  root  m+  =  [2/(2x^  -  x^)]  £_  0.  The  line  segment  in  the 

(V1,V2^  Pdar,e  dictated  by  the  cost  restriction  is  transformed  into  a 

line  segment  whose  projection  on  the  m-axis  in  the  (m,p)  plane  is  the 

interval  (m',m"),  where  m’  =  [2/(3^  +  3403  and  m"  =  [2a/(3iJ>^  + 

The  fact  a  -  2  =  [(2  -  p^)/(l  -  p^)3  -  2  =p  ^/(l  -  p^)  >_  0,  implies  that 

m'  <_  m".  The  double  root  m^  =  [l/(x^  +  x^)3  =  l/[3tIp(l/2  +  1/p") 

+  (9/2)P3  <_  l/fil/g(3/2)  +  (3/2)<J<]  =  m'.  All  this  leads  to  the  conclusion 

that  Q(m)  achieves  its  restricted  maximum  at  m"  =  [2a/(3\J)p  +  6\J.»)3, 

whose  inverse  image  in  the  (v^v^)  plane  is  the  point  =  0  and 

be 

=  1/(3 +  dip).  Thus  the  design  D  which  was  assumed  to /optimal  and 


20 


had  \>3  =  0,  must  also  have  =  0  and  =  1/(3^  +  6i|0  >  0.  But  in 
Lemma  9.3  we  saw  that  if  =  0  then  the  optimal  design  must  have 
=  0.  This  leads  to  a  contradiction  and  the  proof  is  complete. 
Theorem  9.3:  In  the  case  of  equal  costs  and  equal  correlations,  the 
SM  design  is  optimal. 

Proof:  This  follows  by  using  successively  theorem  9.1,  corollary  9.1, 
and  lemmas  9.9  and  9.3. 
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